A context inference and multi-modal approach to mobile information access

Multimodal context-aware computing offers system support that incorporates the environmental, cognitive and computational state of an individual while allowing them to compose inputs and receive outputs across a range of available modalities. Here we present two support planes from our ubiquitous system architecture, entitled Nightingale. These include a multi-modal application framework and context-management and inference approach based on ontologies. In Nightingale the devices in use form a personal area network (PAN ) with access to local (PLAN ) or remote (PWAN ) devices or services as they become available. Our proposed architectural elements aim to simplify multimodal and multi-device interaction, as the proliferation of small personal and inter-connected computing devices increases. ACM Classification